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ABSTRACT 

This  paper  presents  an  overview  of  the  latest  version  of  a  MODTRAN4-based  atmospheric  correction  (or  "compensation") 
algorithm  developed  by  Spectral  Sciences,  Inc.  and  the  Air  Force  Research  Laboratory  for  spectral  imaging  sensors.  New 
upgrades  to  the  algorithm  include  automated  aerosol  retrieval,  cloud  masking,  and  speed  improvements.  In  addition, 
MODTRAN4  has  been  updated  to  correct  recently  discovered  errors  in  the  HITRAN-96  water  line  parameters.  Reflectance 
spectra  retrieved  from  AVIRIS  data  are  compared  with  "ground  truth"  measurements,  and  good  agreement  is  found. 
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1.  INTRODUCTION 

Atmospheric  correction  (or  compensation)  of  spectral  imagery  refers  to  the  retrieval  of  surface  reflectance  spectra  from 
measured  radiances.  Several  methods  for  doing  this  are  described  in  the  literature.  The  simplest  and  by  far  the 
computationally  fastest  is  the  "Empirical  Line  Method"  (ELM).  It  assumes  that  the  radiance  image  contains  some  pixels  with 
a  known  reflectance  spectrum,  and  also  that  the  radiance  and  reflectance  values  for  each  wavelength  channel  of  the  sensor  are 
linearly  related;  therefore,  the  image  can  be  converted  to  reflectance  by  applying  a  simple  gain  and  offset  derived  from  the 
known  pixels.  The  ELM  is  however  not  generally  applicable,  as  known  reflectances  are  often  not  available,  and  the  linearity 
assumption,  which  presumes  uniform  atmospheric  transmission,  scattering  and  adjacency  effects  throughout  the  scene,  may 
not  be  accurate.  Therefore,  alternative  atmospheric  correction  methods  based  on  first-principles  radiation  transport  modeling 
have  been  developed.  Algorithms  applicable  to  scenes  over  land  include  ATREM1,  the  method  of  Green  et  al.2,  which 
requires  additional  input  from  a  calibration  image,  and  an  algorithm  recently  developed  by  Spectral  Sciences,  Inc.  (SSI)  and 
the  Air  Force  Research  Laboratory  (AFRL)'  that  is  based  on  the  MODTRAN4  radiation  transport  model4.  This  paper 
summarizes  the  current  status  of  the  SSI/AFRL  algorithm  and  briefly  describes  recent  upgrades,  which  include  automated 
aerosol  retrieval,  cloud  masking,  speed  improvements,  and  a  MODTRAN4  upgrade  to  correct  recently  discovered  water  line 
parameter  errors5. 


2.  METHODOLOGY 


2.1  Review  of  basic  method 

A  brief  review  of  the  AFRL/SSI  atmospheric  correction  method  is  presented.  We  start  from  a  standard  equation  for  spectral 
radiance  at  a  sensor  pixel,  L*,  that  applies  to  the  solar  wavelength  range  (thermal  emission  is  neglected)  and  flat,  Lambertian 
materials  or  their  equivalents.  The  equation  can  be  written  as6 

L*  =  Ap/(l-peS)  +  Bpe/(l-peS)  +  L*a  (1) 

Here  p  is  the  pixel  surface  reflectance,  pe  is  an  average  surface  reflectance  for  the  pixel  and  a  surrounding  region,  S  is  the 
spherical  albedo  of  the  atmosphere,  L  *,  is  the  radiance  backscattered  by  the  atmosphere,  and  A  and  B  are  coefficients  that 


Correspondence:  Email:  sag@spectral.com;  WWW.spectral.com;  Telephone:  781  273-4770;  Fax:  781  270-1161 


depend  on  atmospheric  and  geometric  conditions  but  not  on  the  surface.  Each  of  these  variables  depends  on  the  spectral 
channel;  the  wavelength  index  has  been  omitted  for  simplicity.  The  first  term  in  Equation  (1)  corresponds  to  radiance  that  is 
reflected  from  the  surface  and  travels  directly  into  the  sensor,  while  the  second  term  corresponds  to  radiance  from  the  surface 
that  is  scattered  by  the  atmosphere  into  the  sensor.  The  distinction  between  p  and  pe  accounts  for  the  "adjacency  effect" 
(spatial  mixing  of  radiance  among  nearby  pixels)  caused  by  atmospheric  scattering.  The  adjacency  effect  correction  may  be 
ignored  by  setting  pe  =  p.  However,  this  can  result  in  significant  reflectance  errors  at  short  wavelengths,  especially  under 
hazy  conditions  and  when  there  are  strong  contrasts  among  the  materials  in  the  scene3. 

The  values  of  A,  B,  S  and  L*a  are  determined  from  MODTRAN4  calculations  that  use  the  viewing  and  solar  angles  and  the 
mean  surface  elevation  of  the  measurement  and  assume  a  certain  model  atmosphere,  aerosol  type,  and  visible  range.  The 
values  of  A,  B,  S  and  L*a  are  strongly  dependent  on  the  water  vapor  column  amount,  which  is  generally  not  well  known  and 
may  vary  across  the  scene.  To  account  for  unknown  and  variable  column  water  vapor,  the  MODTRAN4  calculations  are 
looped  over  a  series  of  different  column  amounts,  then  selected  wavelength  channels  of  the  image  are  analyzed  to  retrieve  an 
estimated  amount  for  each  pixel.  Specifically,  radiance  averages  are  gathered  for  two  sets  of  channels,  an  "absorption"  set 
centered  at  a  water  band  (typically  the  1.13  pm  band)  and  a  "reference"  set  of  channels  taken  from  just  outside  the  band.  A 
2-dimensional  look-up  table  (LUT)  for  retrieving  the  water  vapor  from  these  radiances  is  constructed.  One  dimension  of  the 
table  is  the  reference  to  absorption  ratio  and  the  other  is  the  reference  radiance.  The  second  dimension  accounts  for  a 
reflectance-dependent  variation  in  the  ratio  arising  from  the  different  amounts  of  absorption  in  the  atmospherically-scattered 
and  surface -reflected  components  of  the  radiance.  After  the  water  retrieval  is  performed,  Equation  (1)  is  solved  for  the  pixel 
surface  reflectances  in  all  of  the  sensor  channels.  The  solution  method7'8  involves  computing  a  spatially  averaged  radiance 
image  L  * from  which  the  spatially  averaged  reflectance  pe  is  estimated  using  the  approximate  equation 

L*e  =  (A+B)Pe/(l-peS)  +  L*a  (2) 

The  spatial  averaging  is  performed  using  a  point-spread  function  that  describes  the  relative  contributions  to  the  pixel  radiance 
from  points  on  the  ground  at  different  distances  from  the  direct  line  of  sight.  The  SSI/AFRL  algorithm  approximates  this 
function  as  a  radial  exponential. 

In  the  above  discussion  it  has  been  assumed  that  the  quantity  of  aerosol  or  haze  in  the  scene  has  been  adequately  estimated. 
As  described  previously3,  the  SSI/AFRL  algorithm  includes  a  method  for  retrieving  an  estimated  aerosol/haze  amount  from 
one  or  more  reference  surfaces  in  the  scene  that  have  a  known  reflectance  in  some  wavelength  bandpass.  Best  results  are 
obtained  using  short  (visible)  wavelengths  and  either  a  very  dark  surface,  such  as  vegetation  or  deep  calm  water,  or  a  very 
bright  surface,  such  as  a  white  calibration  target  that  is  large  enough  to  fill  a  whole  pixel.  In  this  method,  calculations  to 
determine  A,  B,  S  and  L*a  are  carried  out  for  the  spectral  channels  in  the  designated  bandpass.  Instead  of  iterating  over 
different  water  vapor  values,  these  calculations  are  performed  over  a  series  of  visible  ranges,  e.g.  200,  100,  50,  33,  25,  20  and 
17  km,  that  are  evenly  spaced  in  their  reciprocals  (optical  depths).  The  user  selects  the  reference  pixels  and  assigns  them  a 
mean  reflectance  value  for  the  selected  channels.  The  algorithm  derives  a  visible  range  for  each  reference  pixel  by 
interpolating  from  a  2-D  LUT  that  depends  on  L  and  L*e.  From  these  results  an  average  or  other  "best"  estimate  of  the 
visible  range  can  be  derived  and  used  for  the  MODTRAN4  calculation  loop  over  water  vapor. 

An  example  of  data  from  the  AVIRIS  sensor  data  processed  with  the  above  procedure  is  shown  in  Figure  1.  The  spectra  are 
of  white  and  black  calibration  panels  at  the  Stennis  Space  Center,  and  were  acquired  from  the  low  altitude  (Twin  Otter) 
platform  in  October,  1998.  After  adjusting  the  wavelength  calibration  slightly  and  performing  the  atmospheric  correction, 
the  spectra  were  smoothed  using  a  "polishing"  algorithm3  9.  The  AVIRIS  spectra  (particularly  the  white  panel)  show  some 
absorption  residuals  adjacent  to  the  cut-out  regions  of  very  strong  water  absorption  and  also  at  the  0.94  pm  water  band,  but 
on  the  whole  the  agreement  with  the  "ground  truth"  spectra  is  good.  The  -0.01  difference  between  the  black  panel  spectra  is 
within  the  variability  and  uncertainty  in  the  ground  truth  measurement. 

2.2  Limitations 

The  basic  atmospheric  correction  method  described  above,  as  well  as  those  in  other  first-principles  codes  such  as  ATREM, 
work  well  in  many  but  not  all  scenes.  In  particular,  they  require  cloud-free  conditions,  the  presence  of  at  least  one  material  in 
the  scene  with  a  known  reflectance  at  a  visible  wavelength,  and  sufficient  computing  time  to  perform  tens  of  mathematical 
operations  per  image  pixel  per  wavelength  channel. 


Figure  1.  Comparisons  of  Atmospherically  Corrected  AVIRIS  Data  with  Ground  Truth  Measurements  for  White  (left)  and  Black  (right) 
Calibration  Panels  at  the  Stennis  Space  Center. 


Cloud  Effects.  Clouds  and  cloud  shadows  pose  several  problems  for  atmospheric  correction.  Not  only  do  cloud- 
contaminated  pixels  have  incorrect  reflectance,  they  also  can  degrade  the  reflectance  accuracy  in  other  parts  of  the  scene. 
This  is  because  clouds  impact  the  spatially  averaged  radiance  L*e  used  in  Equation  (2)  to  generate  pe  for  the  adjacency 
correction.  According  to  theory,  pe  should  account  only  for  reflecting  material  that  is  below  the  scattering  atmosphere. 
While  clouds  typically  lie  below  most  of  the  molecular  (Rayleigh)  scattering,  which  is  important  at  the  very  shortest  (blue- 
violet)  wavelengths,  they  typically  lie  above  the  aerosol  and  haze  layers  that  dominate  the  scattering  in  the  rest  of  the 
spectrum.  Since  clouds  are  typically  much  brighter  than  the  terrain,  pe  is  overestimated,  leading  to  underestimated  surface 
reflectance  retrievals.  Therefore  it  is  important  to  identify  and  remove  cloud-contaminated  pixels  prior  to  the  calculation  of 
pe.  Cloud  shadows  also  produce  reflectance  errors;  however,  their  effects  on  material  identification  can  be  compensated  to 
some  extent,  and  their  impact  on  clear  parts  of  the  scene  is  minimal. 

Absence  of  Accurately  Known  Surfaces.  For  the  purpose  of  aerosol/haze  amount  retrieval,  vegetation,  water,  or  other  dark 
surfaces  can  frequently  be  identified  in  a  scene.  Flowever,  reflectance  values  for  these  surfaces  at  appropriate  wavelengths 
are  often  not  known  to  within  the  accuracy  needed  (around  0.01  reflectance  units  or  better)  for  a  good  retrieval.  Even  with 
"calibrated"  surfaces  the  reflectance  may  not  be  known  to  within  this  accuracy  because  of  complications  caused  by  non- 
Lambertian  bidirectional  reflectance  distribution  functions.  However,  a  method  based  on  a  known  reflectance  ratio  for 
different  wavelengths,  such  as  the  Kaufman  et  a/. 10 1 1  dark  pixel  method,  can  minimize  these  problems. 

Computing  Time  Requirements.  For  a  typical  image  containing  several  hundred  or  more  spectral  channels  and  hundreds  of 
thousands  of  pixels  or  more,  the  speed  of  the  atmospheric  correction  is  fundamentally  limited  by  the  mathematical  operations 
required  to  generate  the  reflectance  values  for  each  pixel  and  channel  from  the  Equation  (1)  parameters.  Current  algorithms, 
such  as  ATREM  and  the  SSI/AFRL  code,  that  use  pixel-specific  values  of  water  vapor  (and  possibly  other  quantities  such  as 
p()  require  tens  of  operations  per  pixel-channel.  Most  of  the  operations  are  consumed  in  interpolating  to  find  the  appropriate 
A,  B,  S  and  L  parameters  for  each  pixel.  A  more  efficient  procedure  is  needed  to  achieve  high-speed  atmospheric 
correction. 

Model  Accuracy.  Any  first-principles  atmospheric  correction  method  is  necessarily  limited  by  the  accuracy  of  its  radiation 
transport  model.  We  have  recently  had  opportunities  to  validate  MODTRAN4  against  analytical  and  Monte  Carlo  scattering 
calculations  as  well  as  against  "exact"  line-by-line  transmittance  calculations  degraded  to  AVIRIS  spectral  resolution. 
Excellent  agreement  was  obtained  in  each  case.  However,  consistency  among  calculations  does  not  guarantee  an  accurate 
representation  of  reality.  Recently,  it  has  been  discovered  that  a  number  of  bands  of  water  vapor  in  the  HITRAN  atlas12, 
upon  which  MODTRAN4  as  well  as  line-by-line  codes  are  based,  have  incorrect  line  strengths.  In  the  0.94  pm  band  the 
errors  are  around  14%,  and  signficantly  impact  the  atmospheric  correction.  These  errors  have  been  corrected  in  the  most 
recent  version  of  MODTRAN4.  Other  known  deficiencies  in  MODTRAN4  include  the  omission  of  certain  collision-induced 
absorption  bands  of  oxygen13. 


3.  UPGRADES 


The  AFRL/SSI  atmospheric  correction  code  has  been  upgraded  with  several  new  algorithms  that  address,  if  not  completely 
solve,  the  abovementioned  limitations: 

•  A  new  method  has  been  implemented  for  retrieving  the  aerosol/haze  amount  from  an  assumed  ratio  of  in-band 
reflectances,  rather  than  from  an  assumed  reflectance  value.  This  method  can  utilize  user-selected  pixels  or  can 
automatically  find  suitable  dark  terrain  pixels10'11  for  the  retrieval. 

•  An  algorithm  for  identifying  cloud-containing  pixels  in  AVIRIS  or  similar  data  has  been  implemented,  and  is  used 
to  improve  the  calculation  ofi*t,  and  pe  in  Equations  (1)  and  (2).  Since  this  algorithm  requires  a  prior  water  vapor 
retrieval,  the  order  and  number  of  steps  in  the  atmospheric  correction  process  has  been  altered. 

•  A  new  method  has  been  developed  that  greatly  reduces  the  number  of  mathematical  operations  required  to  generate 
the  reflectance  values  once  the  atmospheric  parameters  have  been  defined.  The  method  operates  by  averaging  the 
water  vapor  and  pe  values  over  small  groups  of  neighboring  pixels,  so  that  the  same  A,  B,  S,  and  L  *a  parameters  may 
be  assigned  to  all  pixels  in  the  group. 

These  upgrades  are  described  in  more  detail  below.  In  addition,  we  show  an  example  of  the  impact  of  the  water  line  strength 
revisions  on  a  reflectance  retrieval. 

3.1  Aerosol  retrieval  method 

A  general  reflectance  ratio-based  algorithm  has  been  developed  for  retrieving  an  aerosol  amount  (i.e.,  the  visible  range).  The 
reference  pixels  can  be  chosen  by  the  user,  or  dark  pixels  can  be  selected  automatically  based  on  a  specified  maximum 
reflectance.  To  implement  the  Kaufman  et  a/.10’11  method,  one  chooses  bandpasses  centered  at  0.66  pm  and  2.1  pm,  a 
reflectance  ratio  of  ~0.5,  and  a  2.1  pm  reflectance  maximum  of  around  0.1. 

Radiance  images  in  each  of  the  two  bandpasses  are  assembled  from  both  the  original  data  cube  and  from  the  spatially 
averaged  radiance  L*e.  MODTRAN4  calculations  are  conducted  to  determine  A,  B,  S  and  L *  ,  for  a  series  of  trial  visible 
range  values.  For  each  visible  range  and  reference  pixel,  the  reflectance  solutions  for  the  two  bandpasses  are  calculated,  and 
the  reflectance  error  for  the  shorter-wavelength  bandpass  (the  difference  between  the  calculated  reflectance  and  the  calculated 
longer-wavelength  reflectance  times  the  assumed  ratio)  is  tabulated.  A  visible  range  estimate  for  each  selected  pixel  can  be 
obtained  by  interpolating  within  the  resulting  array  of  reflectance  errors  to  find  the  value  that  yields  zero  error.  To  more 
efficiently  calculate  a  scene-average  visible  range,  the  reflectance  error  arrays  are  averaged  over  all  reference  pixels,  and  the 
interpolation  is  performed  on  the  result. 

We  have  tested  this  method  using  different  reference  materials  and  data  from  two  different  imaging  sensors,  including 
AVIRIS.  Using  calibration  panels  as  reference  pixels,  the  visible  range  results  were  compared  with  results  from  the  original 
reflectance -based  method,  and  very  good  agreement  was  found.  Using  natural  dark  terrain,  results  were  assessed  for  different 
reflectance  cutoffs  and  ratio  values  within  the  tolerances  found  by  Kaufman  et  a/.10'11.  Our  preliminary  analysis  indicates  that 
the  typical  obtainable  retrieval  accuracy  is  0.01  to  0.02  per  km  for  Invisible  range).  For  example,  the  difference  between 
retrieved  visible  ranges  values  of  50  km  and  300  km  may  not  be  significant,  whereas  the  differences  between  values  of  20  km 
and  50  km  or  13  km  and  20  km  would  be  considered  significant.  In  some  cases  the  results  can  be  made  less  sensitive  to  the 
value  of  the  reflectance  ratio  by  choosing  a  very  low  reflectance  cutoff,  such  as  0.04,  for  the  dark  pixel  selection.  However, 
for  scenes  containing  shallow  or  turbid  water  bodies  a  low  cutoff  can  produce  anomalous  results,  since  the  low  cutoff  favors 
the  selection  of  the  water  pixels,  which  can  have  a  very  different  reflectance  ratio  than  dark  land  pixels.  A  more  sophisticated 
pixel  selection  method,  such  as  one  that  includes  both  maximum  and  minimum  reflectance  cutoffs  to  discriminate  against 
surface  water,  should  provide  better  results. 

3.2  Identification  and  utilization  of  cloud-containing  pixels 

An  algorithm  has  been  developed  for  generating  a  cloud  "mask"  that  identifies  cloud-containing  pixels  in  the  scene.  At  the 
present  time  the  main  uses  of  the  cloud  mask  in  the  SSEAFRL  atmospheric  correction  code  are  (1)  to  indicate  regions  where 
the  atmospheric  correction  is  invalid  or  suspect,  and  (2)  to  flag  pixels  that  need  to  be  removed  from  the  calculation  of  L *, 


(currently  these  pixels  are  replaced  by  the  scene  average  radiance).  While  it  is  most  important  to  flag  bright,  opaque  clouds, 
it  is  also  desirable  to  find  pixels  that  contain  appreciable  cirrus  or  other  thin  cloud  cover. 


A  number  of  cloud  detection  algorithms  have  been  developed  based  on  multispectral  data.  A  comprehensive  review  is 
presented  by  Ackerman  et  al. 14 ,  who  developed  an  algorithm  for  the  MODIS  sensor.  Their  algorithm  uses  a  combination  of 
tests,  including  (1)  a  color  balance  test  based  on  a  SWIR/red  reflectance  ratio  (0.9  <  p(0-87  pm)  /p{ 0.66  pm)  <  1.1  indicates 
clouds],  (2)  a  reflectance  test  at  0.94  pm  (a  high  signal  correlates  with  low  column  water  vapor,  hence  reflection  from  a 
bright,  elevated  object),  and  (3)  a  variety  of  brightness  tests  at  IR  wavelengths.  In  a  paper  on  simple  algorithms  for 
multispectral  atmospheric  correction,  Borel  et  al.  199915  discuss  an  analogue  to  the  SWIR/red  ratio  test  that  combines  an 
upper  threshold  on  the  NDVI  (Normalized  Differential  Vegetation  Index)  with  a  lower  threshold  on  the  SWIR  bandpass  (i.e., 
a  brightness  test).  They  also  describe  a  water  vapor  absorption  test  involving  a  continuum  interpolated  band  ratio  (CIBR). 

With  AVIRIS  there  is  no  IR  coverage  past  2.5  pm,  but  there  is  high  spectral  resolution  that  permits  a  very  good  column  water 
vapor  retrieval.  Therefore,  following  Ackerman  and  Borel,  we  devised  a  cloud  mask  based  on  combining  tests  for  brightness, 
color  balance,  and  low  column  water  in  the  visible  and  SWIR  regions.  Because  of  processing  time  constraints,  it  is 
advantageous  to  utilize  bands  that  are  already  being  gathered  by  the  atmospheric  correction  code  for  other  purposes  (e.g.,  2.1 
pm,  1.13  pm  water  absorption  and  reference  bandpasses,  0.66  pm,  red,  blue,  and  green  bandpasses  used  for  image  display) 
and  to  use  the  retrieved  water  vapor  amounts.  From  these  data  we  implemented  analogues  of  the  tests  described  above. 

From  the  standpoint  of  clear-sky  atmospheric  correction,  the  main  effect  of  clouds  in  the  scene  arises  from  the  adjacency 
effect  compensation,  which  requires  a  spatially  smoothed  radiance.  It  is  not  appropriate  to  include  cloudy  pixels  in  the 
smoothed  radiance,  which  means  that  the  cloud  mask  must  be  determined  prior  to  both  the  aerosol  retrieval  and  the 
atmospheric  correction.  A  cloud  test  based  on  water  vapor  must  use  some  assumed  aerosol  amount,  and  a  test  based  on 
reflectances  cannot  include  the  adjacency  effect  compensation.  Given  these  requirements,  the  preferred  sequence  of  steps  for 
the  atmospheric  correction  process  is  as  follows: 

1.  Initial  water  vapor  retrieval.  A  nominal  visible  range  (e.g.,  50  km)  is  assumed. 

2.  Cloud  mask  generation.  Brightness  and  color  balance  tests  are  applied  to  establish  probable  clear  pixels,  and  a 
spatially  average  water  vapor  average  is  taken.  Pixels  containing  significantly  lower  water  vapor  than  this  spatial 
average  are  identified,  and  the  results  of  this  test  and  the  other  tests  are  combined  to  define  the  opaque  cloud  mask. 

3.  Spatial  averaging  of  the  radiance  using  the  adjacency  effect  point-spread  function.  Prior  to  averaging,  the  scene- 
average  radiance  replaces  the  actual  radiance  in  the  cloud-masked  pixels. 

4.  Aerosol  (visible  range)  retrieval.  The  automated  ratio-based  algorithm  is  used  with  adjacency  correction  (both  the 
smoothed  and  unsmoothed  radiances  are  input). 

5.  Refined  water  vapor  retrieval.  The  derived  visible  range  and  perhaps  a  narrowed  range  of  water  column  amounts 
are  used. 

6.  The  cloud  mask  may  be  recalculated,  but  it  should  not  be  much  different  than  before. 

7.  Full  reflectance  spectrum  retrieval. 

A  convenient  method  for  the  cloud  mask  generation,  incorporated  in  the  most  recent  version  of  the  SSI/AFRL  atmospheric 
correction  method,  is  outlined  below.  Brightness,  color  balance,  and  water  vapor  tests  are  used  together  to  define  a  mask  for 
"ordinary",  low-altitude  clouds.  In  addition,  1.38  pm  data  are  used  to  define  a  separate  mask  for  high-altitude  (i.e.,  cirrus) 
clouds,  following  the  work  of  Gao  and  co-workers16'17. 

The  brightness  test  requires  that  an  atmospheric  correction  from  radiance  to  reflectance  units  be  performed  for  at  least  one 
sensor  bandpass.  Since  the  water  reference  reflectance  channel  average  (taken  from  either  side  of  1.13  pm)  and  a 
corresponding  reflectance  are  already  generated,  it  can  be  used  for  the  brightness  test.  Borel  et  al. 15  recommend  a  reflectance 
lower  threshold  of  around  0.3  for  clouds  in  the  SWIR.  We  have  obtained  good  results  with  a  similar  value,  0.4. 


The  color  balance  test  involves  comparing  at  least  two  bandpasses  at  different  wavelengths.  One  bandpass  can  be  the  water 
reference,  the  second  can  be  a  visible  bandpass,  preferably  green  wavelengths,  properly  scaled.  The  test  outcome  is  positive 
if  the  ratio  of  effective  reflectances  (radiance  divided  by  the  solar  function)  in  the  green  and  water  reference  bandpasses  is 
unity  to  within  some  bounding  values.  Suitable  bounding  values  determined  by  trial  and  error  are  0.4  and  1.2. 

The  low-water  test  involves  comparing  the  pixel's  column  water  vapor  with  a  threshold  value  that  is  derived  from  pixels  that 
fail  both  the  brightness  and  color  balance  tests  and  therefore  are  classified  as  clear.  The  threshold  is  defined  with  respect  to  a 
clear-pixel  spatial  average,  obtained  by  convolving  the  clear  pixel  image  with  a  window  that  is  smaller  than  the  image. 
Ideally,  the  window  should  be  larger  than  typical  cloud  dimensions  but  smaller  than  typical  large-scale  topographic 
dimensions.  For  example,  for  AVIRIS  data  taken  from  a  20  km  altitude,  a  suitable  window  size  is  around  40  x  40  pixels. 
The  outcome  of  the  low-water  test  is  defined  to  be  positive  for  a  pixel  if  its  column  water  vapor  is  less  than  85%  of  the  clear- 
pixel  value. 

To  generate  the  high  cloud  mask,  one  or  two  channels  of  data  in  the  center  of  the  1.38  pm  water  band  are  selected.  The  data 
are  histogrammed,  the  maximum  of  the  histogram  is  assigned  to  the  background  level,  and  pixels  whose  signals  exceed  some 
threshold  (presently  0.03  pW/nm/cnr/sr)  above  the  background  level  are  flagged.  We  have  found  that  this  method  often 
detects  thick,  lower-altitude  clouds  as  well  as  cirrus  clouds. 

To  date,  limited  testing  of  the  cloud  identification  algorithm  has  been  conducted.  An  application  to  an  AVIRIS  image  taken 
near  North  Conway,  NH  is  shown  in  Figure  2.  Except  where  the  clouds  are  extremely  thin,  all  pixels  that  appear  to  the  eye  to 
be  contaminated  with  clouds  are  flagged  by  the  algorithm,  and  false  positives  are  not  evident.  A  low  rate  of  false  positives, 
particularly  for  the  "ordinary"  cloud  test,  has  been  verified  using  a  variety  of  cloud-free  scenes. 


Figure  2.  Left,  AVIRIS  Radiance  Image.  Right,  Calculated  Cloud  Mask.  Different  shades  of  gray  denote  clouds  containing  pixels 
selected  by  different  tests. 

3.3  Reflectance  calculation  speedup 

The  reflectance  calculation  described  in  Section  2.1  can  be  made  much  faster,  with  little  sacrifice  in  accuracy,  by 
approximating  A,  B,  S,  L  * ,  and  pe  using  average  values  for  a  group  of  nearby  pixels  (such  as  an  N  x  N  array),  referred  to  here 
as  a  "superpixel".  The  method  takes  advantage  of  the  fact  that  Equation  (1)  relating  radiance  to  reflectance  can  be 
transformed  into  the  simple  linear  equation, 

p=mL*  +  b  (3) 

where  m  and  b  are  expressed  in  terms  of  superpixel  values  for  A,  B,  S,  L  and  pe.  Suitable  values  for  these  parameters  are 
determined  by  using  superpixel-average  water  vapor  amounts  to  interpolate  from  MODTRAN4-derived  LUTs.  The 
superpixel  water  vapor  amounts  may  be  either  averages  of  the  retrievals  from  individual  pixels  or  retrievals  from  superpixel- 
average  radiances,  pe  is  calculated  from  the  value  of/.*,  for  the  superpixel.  Note  that  since  L*e  is  itself  a  spatial  average,  for 
all  practical  purposes  it  does  not  need  to  be  calculated  on  a  single-pixel  basis  in  the  first  place.  Once  m  and  b  are  defined,  p 
is  calculated  from  L  *  for  each  pixel. 


The  speedup  in  the  calculation  of  the  reflectance  compared  to  the  standard  pixel-by-pixel  approach  derives  from  the  fact  that 
the  interpolations  and  other  mathematical  steps  required  to  generate  m  and  b  (approximately  21  arithmetic  operations)  are 
performed  only  once  per  N  x  N  pixels.  In  the  limit  of  large  N,  the  number  of  operations  per  pixel-channel  reduces  to  the  2 
operations  in  Equation  (3),  which  are  the  same  as  in  the  Empirical  Line  Method.  Most  of  the  speed  benefit  can  be  achieved 
even  with  a  modest  superpixel  size,  such  as  N  =  4  (see  Table  1),  which  yields  only  marginal  differences  with  the  "exact"  N  = 
1  results. 

To  date,  we  have  implemented  the  superpixel  method  in  an  IDL  language  code  and  obtained  a  fourfold  improvement  in 
speed,  to  around  1/3  s  per  line  of  614  AVIRIS  pixels  on  a  330  MElz  PC.  A  further  order-of-magnitude  speedup  is  anticipated 
with  recoding  to  a  more  efficient  language  such  as  C  or  FORTRAN. 

Table  1.  Theoretical  Number  of  Floating  Point  Operations  Per  Pixel-channel  using  the  Superpixel  Method  for  Calculating  Spectral 
Reflectance. 


Superpixel 

dimensions 

FLOPs  /  pixel  / 
channel 

lxl 

23 

2x2 

9.25 

3x3 

4.33 

4x4 

3.31 

3.4  Revised  water  line  strengths 

A  revised  HITRAN  line  list11,  containing  the  Giver  et  al.5  water  line  parameter  corrections,  was  used  to  formulate  a  new  set 
of  water  band  model  parameters  for  MODTRAN4.  The  impact  of  the  new  parameters  on  AVIRIS  data  is  shown  in  Figure  3 
for  the  Stennis  Space  Center  white  panel.  To  best  show  the  residual  errors,  no  spectral  "polishing"  was  applied.  The  new 
parameters  virtually  eliminate  the  anomalous  0.94  pm  absorption  which  was  found  earlier,  and  which  has  been  a  persistent 
artifact  in  AVIRIS  retrievals,  especially  in  moist  atmospheres.  At  most  other  wavelengths  the  two  sets  of  residts  are  nearly 
identical.  The  new  parameters  led  to  a  very  small  increase  in  the  retrieved  water  column  amount,  from  1550  to  1570  atm-cm, 
due  to  a  ~1%  change  in  the  1.13  pm  band  strength.  Both  results  are  in  remarkable  (perhaps  partly  fortuitous)  agreement  with 
the  value  of  1560  atm-cm  measured  by  a  radiosonde  near  the  time  and  location  of  the  AVIRIS  flight. 


Figure  3.  Comparison  of  White  Panel  Reflectance  Spectra  retrieved  from  AVIRIS  Data  Using  MODTRAN4  with  Corrected  (solid)  and 
Original  (dashed)  HITRAN  Water  Line  Parameters. 


4.  CONCLUSIONS 


Considerable  progress  has  been  made  on  several  fronts  to  improve  the  SSI/AFRL  atmospheric  correction  algorithm's  speed, 
accuracy,  and  automated  application  to  cloudy  and  hazy  scenes.  Work  is  in  progress  to  develop  algorithms  that  treat  cloud  or 
other  shadowing  effects  and  that  retrieve  information  on  the  aerosol  type  (i.e.,  particle  size  distribution  and/or  single¬ 
scattering  albedo)  as  well  as  amount.  The  potential  also  exists  to  develop  an  even  faster  atmospheric  correction  capability, 
requiring  only  a  few  mathematical  operations  per  pixel-channel,  by  combining  the  fast  reflectance  calculation  method 
described  here  with  a  pre-calculated  library  of  MODTRAN4  runs.  This  would  enable  a  512-line  AVIRIS  data  cube  to  be 
atmospherically  corrected  with  high  accuracy  in  only  a  few  minutes  using  a  present-day  PC. 

ACKNOWLEDGEMENTS 

We  thank  Greg  Terrie  (NASA  SSC)  for  providing  us  with  AVIRIS  data  and  ground  truth  measurements  and  L.  Rothman 
(Harvard-Smithsonian  Center  for  Astrophysics)  and  S.A.  Clough  (Atmospheric  and  Environmental  Research,  Inc.)  for 
providing  the  revised  HITRAN  line  list.  We  gratefully  acknowledge  support  from  AFRL  and  SITAC  under  USAF  Contract 
No.  F19628-98-C-0050,  from  NASA  under  SBIR  Contract  No.  NAS13-99014,  and  from  Spectral  Sciences,  Inc. 

REFERENCES 

1.  B.-C.  Gao,  K.B.  Fleidebrecht  and  A.F.FI.  Goetz,  Atmosphere  Removal  Program  (ATREM)  Version  2.0  Users  Guide, 
Center  for  the  Study  of  Earth  from  Space/CIRES,  University  of  Colorado,  Boulder,  Colorado,  26  1996. 

2.  R.O.  Green,  D.A.  Roberts,  and  J.E.  Conel,  "Characterization  and  Compensation  of  the  Atmosphere  for  Inversion  of 
AVIRIS  Calibrated  Radiance  to  Apparent  Surface  Reflectance,"  Summaries  of  the  Sixth  Annual  JPL  Airborne  Earth 
Science  Workshop,  IPL  Publication  96-4,  Vol.  1,  Pasadena,  California,  pp.  135-146,  1996. 

3.  S.M.  Adler-Golden,  M.W.  Matthew,  L.S.  Bernstein,  R.Y.  Levine,  A.  Berk,  S.C.  Richtsmeier,  P.K.  Acharya,  G.P. 
Anderson,  G.  Felde,  I.  Gardner,  M.  Hoke,  L.S.  leong,  B.  Pukall,  I.  Mello,  A.  Ratkowski  and  H.-H.  Burke,  Atmospheric 
Correction  for  Short-wave  Spectral  Imagery  based  on  MODTRAN4,”  SPIE  Proceeding,  Imaging  Spectrometry’  V,  3753, 
pp.  61-69,  1999. 

4.  A.  Berk,  L.  S.  Bernstein,  G.  P.  Anderson,  P.  K.  Acharya,  D.  C.  Robertson,  I  .H.  Chetwynd  and  S.  M.  Adler-Golden, 
"MODTRAN  Cloud  and  Multiple  Scattering  Upgrades  with  Application  to  AVIRIS,"  Remote  Sensing  Environment 
65,  367,  1998. 

5.  L.P.  Giver,  C.  Chackerian,  Ir.,  and  P.  Varanasi,  "Visible  and  Near-infrared  H2160  Line  Intensity  Corrections  for 
HITRAN-96,"  J.  Quant.  Spectrosc.  Radiat.  Transfer,  in  press,  2000. 

6.  E.F.  Vermote,  D.  Tanre,  I.L.  Deuze,  M.  Herman  and  J.J.  Morcrette, ,  Second  Simulation  of  the  Satellite  Signal  in  the 
Solar  Spectrum  (6S),  6S  User  Guide  Version  6.0,  NASA-GSFC,  Greenbelt,  Maryland,  134,  1994. 

7.  R.  Richter,  "Atmospheric  Correction  of  DAIS  Hyperspectral  Image  Data,  "  SPIE  AEROSENSE  '96  Conference,  Orlando, 
FL,  April  8-12,  SPIE  Proceedings,  2758,  1996. 

8.  E.F.  Vermote,  N.  El  Saleous,  C.O.  lustice,  Y.I.  Kaufman,  I.L.  Privette,  L.  Remer,  I.C.  Roger  and  D.  Tanre, 

"Atmospheric  Correction  of  Visible  to  Middle-Infrared  EOS-MODIS  Data  Over  Land  Surfaces:  Background, 
Operational  Algorithm  and  Validation,"  J.  Geophys.  Res.,  102,  pp.  17131-17141,  1997. 

9.  I.W.  Boardman,  "Post- ATREM  Polishing  of  AVIRIS  Apparent  Reflectance  Data  using  EFFORT:  a  Lesson  in  Accuracy 
versus  Precision,"  Summaries  of  the  Seventh  JPL  Airborne  Earth  Science  Workshop,  IPL  Publication  97-21, 

Vol.  l,pp.  53,  1998. 

10.  Y.  I.  Kaufman,  D.  Tanre,  L.  A.  Remer,  E.  F.  Vermote,  A.  Chu,  and  B.  N.  Holben,  "Operational  Remote  Sensing  of 
Tropospheric  Aerosol  over  Land  from  EOS  Moderate  Imaging  Spectroradiometer,"  J.  Geophys.  Res.  102,  17051,  1997. 

11.  Y.I.  Kaufman,  A.E.  Wald,  L.A.  Remer,  B.-C.  Gao,  R.-R.  Li,  and  L.  Flynn,  "The  MODIS  2.1-pm  Channel— Correlation 
with  Visible  Reflectance  for  Use  in  Remote  Sensing  of  Aerosol,"  IEEE  Transactions  on  Geoscience  and  Remote 
Sensing,  35,  pp.  1286-1298, 1997. 

12.  L.S.  Rothman,  C.P.  Rinsland,  A.  Goldman,  S.T.  Massie,  D.P.  Edwards,  I.-M.  Flaud,  A.  Perrin,  C.  Camy-Peyret,  V. 

Dana,  I.-Y.  Mandin,  I.  Schroeder,  A.  McCann,  R.R.  Gamache,  R.B.  Wattson,  K.  Yoshino,  K.V.  Chance,  K.W.  lucks, 
L.R.  Brown,  V.  Nemtchinov  and  P.  Varanasi,  "The  HITRAN  Molecular  Spectroscopic  Database  and  HAWKS  (HITRAN 
Atmospheric  Workstation):  1996  Edition,"  J.  Quant.  Spectrosc.  Radiat.  Transfer,  60,  pp.  665-710,  1998. 

13.  S.  Solomon,  R.W.  Portmann,  R.W.  Sanders  and  I.S.  Daniel,  "Absorption  of  Solar  Radiation  by  Water  Vapor,  Oxygen 
and  Related  Collision  Pairs  in  the  Earth's  Atmosphere,"  J.  Geophys.  Res.,  103,  pp.  3847-3858,  1998. 


14.  S.A.  Ackerman,  K.I.  Strabala,  W.P.  Menzel,  R.A.  Frey,  C.C.  Moeller,  and  L.E.  Gumley,  "Discriminating  Clear  Sky  from 
Clouds  with  MODIS,"  J.  Geophys.  Res.  103,  32141,  1998. 

15.  C.C.  Borel,  P.V.  Villeneuve,  W.B.  Clodius,  J.J.  Szymanski,  and  A.B.  Davis,  "Practical  Atmospheric  Correction 
Algorithms  for  a  Multi-spectral  Sensor  from  the  Visible  through  the  Thermal  Spectral  Regions,"  SPIE  '99  Paper,  Conf. 
3717-19,  Los  Alamos  National  Laboratory  Report  No.  LA-UR-99-1374,  1999. 

16.  B.-C.  Gao,  Y.  J.  Kaufman,  W.  Han,  and  W.  J.  Wiscombe,  "Removal  of  Thin  Cirrus  Path  Radiances  in  the  0.4  -  1.0  pm 
Spectral  Region  Using  the  1.375-pm  Strong  Water  Vapor  Absorption  Channel,"  Summaries  of  the  Seventh  JPL  Airborne 
Earth  Science  Workshop,  JPL  Publication  97-21,  Vol.  1,  pp.  121-130,  1998. 

17.  B.-C.  Gao,  A.F.H.  Goetz,  and  W.J.  Wiscombe,  "Cirrus  Cloud  Detection  from  Airborne  Imaging  Spectrometer  Data 
Using  the  1.38  pm  Water  Vapor  Band,"  J.  Geophys.  Res.  Lett  20,  pp.  301-304,  1993. 


